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ABSTRACT 

We  give  a  bound  on  the  distance  between  an  arbitrary  point  and  the  solution  set  of  a 
monotone  linear  complementarity  problem  in  terms  of  a  condition  constant  which  depends 
on  the  problem  data  only  and  a  residual  function  of  the  violations  of  the  complementarity 
problem  conditions  by  the  point  considered.  When  the  point  satisfies  the  linear  inequalities 
of  the  complementarity  problem,  the  residual  consists  of  the  complementarity  condition 
x(Mx  +  9)  plus  its  square  root:  (x[Mx  +  This  latter  term  is  essential  and  without 

C*  s- 

which  the  error  bound  cannot  hold.  We  also  show  that  another  natural  residual  that  has 
been  employed  to  bound  errors  for  strictly  monotone  linear  complementarity  problems, 

I 

fails  to  bound  errors  for  the  monotone  case  considered  here.  .. 

*  *  f* 
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SIGNIFICANCE  AND  EXPLANATION 


The  monotone  linear  complementarity  problem  provides  a  unified  framework  for  many 
fundamental  mathematical  programming  problems  such  as  linear  and  quadratic  programs 
and  bimatrix  games.  In  this  work  we  provide  error  bounds  for  points,  which  may  not 
satisfy  the  conditions  of  the  problem,  in  terms  of  the  amounts  of  the  violations  of  these 
conditions. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive  summary 
lies  with  MRC,  and  not  with  the  authors  of  this  report. 
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Error  Bounds  for  Monotone 
Linear  Complementarity  Problems 

O.  L.  Mangasarian  &  T.-H.  Shiau 

1.  Introduction 

Consider  the  monotone  linear  complementarity  problem  [2]  of  finding  an  x  in  the 
n-dimensional  real  space  i?"  such  that 

(1.1)  Mx  +  9  >  0,  X  >  0,  x(Afi  +  9)  =  0 

where  M  is  an  n  x  n  positive  semidefinite  real  matrix  and  9  is  in  /?”.  Suppose  that  the 
problem  has  a  nonempty  solution  set  S.  The  question  we  wish  to  address  in  this  work  is 
the  following.  Given  an  arbitrary  point  x  in  which  violates  one  or  all  three  conditions  of 

(1.1) ,  how  close  is  X  to  5  in  terms  of  its  violations  of  the  conditions  (1.1)?  More  specifically 
we  are  interested  in  a  measure  of  the  distance  between  x  and  5  in  terms  of  the  residual 
vector 

(1.2)  ((-Afx  -  9)+,  (-x)+,  lx(Mx  +  9)1) 

where  ((-x)  +  ),  =  max  (0, -xj,  1  =  l,...,n.  Note  that  the  residual  vector  vanishes  if  and 
only  if  X  is  in  the  solution  set  5.  A  principal  result,  Theorem  2.7  below,  shows  that  for  each 
X  in  f?"  there  exists  an  x(i)  in  5  such  that  the  oc  -norm  distance  ||x-x(x)|ioo  is  bounded 
by  a  condition  constant  T2{M,  9)  (dependent  on  M  and  9  only)  times  a  positive  function  of 
the  residual  vector  (1.2)  which  vanishes  if  and  only  if  the  residual  vector  (1.2)  is  zero.  The 
condition  constant  T2{M,  9)  plays  the  same  role  for  the  monotone  linear  complementarity 
problem  (1.1)  as  does  ||A~‘j'  for  a  nonsingular  n  x  n  real  matrix  in  bounding  the  distance 
||x  -  x|i,  between  an  arbitrary  point  x  in  R''  and  the  exact  solution  x  =  to  Ax  =  6, 

by  the  residual  vector  Ax  —  b  as  follows 

l|x  -  x!l  <  |1A'*||  liAx  -  6|1 
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Theorem  2.7  simplifies  considerably  to  ('orollary  2.8  if  the  point  x  in  is  feasible,  that 
is  it  satisfies  the  first  two  inequalities  of  (l.l),  in  which  case  the  error  ||z  —  x(j)  |oo  >s 
bounded  by  T2{M,  q)  times  the  residual  x{Mx  *  9)  -r  [x{Mx  +  9))  .  Example  2.9  shows 

that  the  term  {x{Mx  ^  q))  is  an  essential  part  of  the  residual,  without  which  the  error 
I  -  t(i)'|oo  cannot  be  bounded.  Theorem  2.11  and  Corollary  2.12  give  bounds  on  the 
relative  error  j  i  -  x(i):;oc/  i'fzjlloc  in  terms  of  the  condition  number  T2{M,  q)  •  iiA/||oo 
times  a  relative  residual  function. 


Pang  has  given  error  bounds  for  nonlinear  complementarity  problems  [8j  and  linearly 
constrained  variational  inequalities  i9;.  When  applied  to  the  linear  complementarity  prob¬ 
lem  (1.1)  Pang  requires  in  effect  8,  Lemma  2j  that  the  matrix  M  be  positive  definite, 
whereas  our  results  merely  require  that  M  be  positive  semidefinite.  Although  Pang's 
natural  residual  8,  Lemma  2 

n 

(1.3)  (  ^  (min  {it,  A/,z  + 

1 

is  simpler  than  ours,  we  show'  by  means  of  Example  2.10  that  this  residual  cannot  be  used 
as  an  error  measure  for  the  positive  semidefinite  case  under  consideration  in  this  paper. 

A  brief  word  about  notation  and  some  basic  concepts  employed.  For  a  vector  x  in  the 
r?-dimensional  real  space  /?".  i  and  x^  will  denote  the  vectors  in  /?"  with  components 
I,  X,  and  (x^),  max  {i,,  0}.  r  -  !,...,«  respectively.  For  a  norm  ||x||^  on 
H'' .  X  will  denote  the  dual  norm  3,71  on  /?".  that  is  iX  :f)»  max  xy,  where  xy 

n 

denotes  the  scalar  production  J,y, .  The  generalized  Cauchy-Schwarz  inequality  |xyl  < 

t=  1 

-T  •  y  .1* .  for  ^  and  y  in  follows  immediately  from  this  definition  of  the  dual  norm. 

11  1  . 

For  1  <  p.  q  <  oc.  and  -  -  -  =  1,  the  p-norm  (  >  )  and  the  g-norm  are  dual 

P  9 

norms  on  /?"  7  .  If  •  [  p  is  a  norm  on  i?”.  we  shall,  with  a  slight  abuse  of  notation,  let 
■  .'w  also  denote  the  corresponding  norm  on  R"'  for  m  /  n.  For  an  m  x  n  real  matrix  A 
signified  by  A  t  A,  denotes  the  ith  row.  A-j  denotes  the  jth  column.  Aj  A,^/. 

and  A  j  :  A  j.  j,  where  /  C  { 1 , .... m)  and  J  C  {1,  ...,n}.  'A  7?  denotes  the  matrix  norm 

7  subordinate  to  the  vector  norm  j|  •  ;/?,  that  is  jlAH/?  =  max  !|Axii^).  The  consistency 

!lzi:  )  ■-- 1 

condition  .4xj  7  <  A  17)  follows  immediately  from  this  definition  of  a  matrix  norm. 
A  monotonic  norm  on  ff"  is  any  norm  ||  •  |  on  /?"  such  that  for  a,  6  in  /?”,  !laj  <  i|6|l 


whenever  a  <  b  or  equivalently  if  !|aj|  =  ||  ja]  ||  [3,  p.  47j.  The  p-norm  for  p  >  1  is 
monolonic  7  .  A  vector  of  ones  in  any  real  space  will  be  denoted  by  e.  The  identity 
matrix  of  any  order  will  be  denoted  by  I.  The  nonnegative  orthant  in  /?"  will  be  denoted 


2.  Principal  Results 

Throughout  this  paper  M  will  denote  an  n  x  n  real  matrix,  q  a  point  in  72",  (Af,  q) 
will  denote  the  linear  complementarity  problem  (l.l),  and 

(2.1)  + 

A 

(2.2)  5  =  5(A/,  q)  :=  {x\Mx  +  9  >  0,  x  >  0} 

(2.3)  5  =  S[M,  q)  {x|Mi  +  9  >  0,  i  >  0,  i(Afx  +  9)  =  0} 

It  is  well  known  [2]  that  the  solution  set  S  is  nonempty  if  and  only  if  the  feasible  set  5 
is  nonempty,  provided  that  M  is  positive  semidefinite.  We  begin  with  .^ome  preliminary 
results. 

2.1  Lemma  (Adler  &  Gale  jl];  Polyhedrality  of  the  solution  set  of  (A/,  9)).  Let  M  be 
positive  semidefinite  and  let  x  €  S.  Then 

S  =  {x|Mi  +  9  >  0,  X  >  0,  x(2Mx  +  9)  +  9*  <  0,  M(x  -  i)  =  0} 

Proof  (i  -  x)(Mx  +  9  -  (Mx  +  9))  =  (x  -  x)Af(x  -  x). 

Hence 

x{Mx  +  9)  =  x{Mx  +  9)  +  x(A/x  +  9)  +  (x  -  x)M{x  -  x) 

Since  for  x  6  5,  each  quantity  on  the  right  hand  side  of  the  last  equation  is  nonnegative  it 
follows  that 

5  =  {x  £  S|x(Mi  +  9)  =  0} 

-  {x|Mi  +  9  >  0,  X  >  0,  x(Afx  +  9)  x(Mx  +  9)  <  0,  (x  -  x)M{x  -  x)  =  0} 

-  {xjMx  +  9  >  0,  X  >  0,  x{2Mx  +  9)  +  9x  <  0,  M(x  -  x)  =  0} 

The  last  equality  follows  from  the  equivalence  of  zMz  -  0  and  Mz  =  0  for  a  positive 
semidefinite  matrix,  since  2\Iz,  the  gradient  of  zMz,  must  vanish  when  zMz  =  0.  I 

2.2  Lemma  Let  M  €  be  symmetric  positive  semidefinite.  Then  Afx  =  0  <=> 


Proof  =  0  =>  Mx  =  0  =>  =  0  =>  xM^/^M^^’^x  =  0  =>|;M*/^i||2  = 

0=>A/*'2r  =  0.  I 

Lemmas  2.1  and  2.2  combined  give  the  following. 

2.3  Lemma  Let  M  be  positive  semidehnite  and  let  i  £  5.  Then 


(2.4)  S  =  {xjMi  9  >  0,  X  >  0,  x(2Afx  +  q)  +  qx  <  0,  -  x)  =  0} 

By  using  the  polyhedral  characterization  (2.4)  and  the  condition  number  result  for 
linear  inequalities  and  equalities  of  either  l4j  or  [6]  we  are  able  to  obtain  a  preliminary 
bound  on  the  distance  between  any  point  in  iZ"  and  the  solution  set  S  of  (M,  9). 

2.4  Proposition  Let  M  be  positive  semidefinite  and  let  x  E  S.  For  each  x  in  iZ"  there 
exists  an  x(x)  in  5  which  is  independent  of  x  such  that 


i  x  -  i(x)  ioc  <  q),,{-Mx  -  q,  -x,  x{2Mx  +  g)  +  Q^).,  M*/^(x  -  x)\\p 


where  i  •  |  ^  is  some  norm  on  /Z^”"*"*,  ||  •  ||j9*  is  its  dual  norm  and 


(2.5)  7,,(.V/,g) 


inf  sup  {  i|u,v,2,$||0* 


Rows  of 


corresponding  to 


\\uM  +  v  +  zM^/^-^{2xM  +  q)h  =  U  ] 
(u,r,0  >0 

/  ^  \ 

/ 

Mi/2 

V  2xM  +  q  J 
nonzero  elements  of  (u,r,2,  $)  are  lin.  in- 

!  dep. 


Proof  Follows  by  the  application  of  Theorem  2.2  '  j6]  to  5  as  defined  by  (2.4).  I 
We  need  two  more  lemmas  before  stating  our  principal  results. 

2.5  Lemma  Let  x  €  S.  Then  for  each  x  G  iZ" 

jjM*/^(x  -  x)||2  <  x{Mx  +  q)+  Wi-Mx  -  q,  -x)+||^  •  ||i,  Mx  +  g|i^* 


where  ||  •  (j^  is  some  norm  on  iZ^”  and  ||  •  1|^*  is  its  dual  norm. 


-  x)j|  =  (x  -  x)M{x  -  x)  =  x[Mx  q)  +  x{-Mx  -  q)  +  {-x){Mx  +  9) 


<  x{Mx  +  9)  +  x[-Mx  -  9)4.  +  (-i)  +  (Mx  +  9) 

<  x(Mx  +  9)  +  ||(-Mx  -  9,  -x)  +  |(/?  •  ||x,  Mx  +  q\\p*  .  I 

2.6  Lemma  Let  x  f_  S  and  let  M  be  positive  semidefinite.  Then  for  any  x  € 

(x(A/x  +  9)  4  x{Mx  +  ?))+  <  (x(A/^  4 

Proof 

(x(Afx  4  9)  4  x{Mx  -t-  9))^ 

=  (x(Mx  4  9)  -  (x  -  x)M[x  -  x))^ 

<(x(Aix49))^.  I 

We  are  now  ready  for  our  principal  results. 

2.7  Theorem  (Absolute  error  bound  for  approximate  solutions  of  monotone  linear 
complementarity  problems)  Let  M  be  positive  semidefinite  and  let  S  ^  <i>.  For  each  x  in 
/?"  there  exists  an  x(x)  in  5  such  that 

X  -  x(x)  ;„c  <  r2{M,  9)  [i|(x(Afx  4  9),  -Mx  -  9,  -x)^  !|2 


4  (x(Mx  4  9)  4  <7^i|(-Mx  -  9,  -x)+|l/9)*^^] 
whore  T2{M.  9)  is  defined  by  (2.5),  ||  •  ||^  is  some  norm  on  and  op  is  defined  by 


9)  :=  min  ||x.  Mx  4  9l|/?* 
xes 


Proof  Hy  |2;  5  4  0  since  S  ^  <t>.  Let  x  €  5.  Then  by  Proposition  2.4  above,  for  each  x 
in  /f"  there  exists  an  x(x)  in  S  which  is  independent  of  i  such  that 

X  x(x)  ^  ■  T2(M,  9)!i((-Mx  -  9,  -X,  x(Mx  x  q)  ->■  x(Mx  4  9))^  »  M’^^(x  -  x)||2 

•  9)[||(-A^x  -  9,  -X,  x(Mx  f  9))^  ll^ 

--  (x(Mx  +  9)  +  l|(-Mx  -  9,  -x)4  li;,  •  ;lx,  Mx  +  9ll/?*)''^^j 

(By  Lemmas  2.6,  2.5  and 
monotonicty  of  the  2-norm  |3].) 


Hence  taking  the  infimum  of  the  right  side  over  all  i  in  S  we  get 


Ijz  -  i(i)lioo  <  q)[\\{x{Mx  +  g),  -Mi  -  q,  -i)^||2 

+  (i(Mi  +  g)  ^  a^l|(-Mi  -  g,  -x)+ 1|^)  .  I 

When  I  is  in  S,  Theorem  2.7  simplifies  to  the  following. 

2.8  Corollary  (Absolute  error  bounds  for  feasible  approximate  solutions  of  monotone 
complementarity  problems)  Let  M  be  positive  semidefintie  and  let  S  ^  <j>.  For  each  i  in  5 
there  exists  an  x[x)  in  S  such  that 

(2.8)  lii  -  i(i)!loo  <  ’■2(M,  g)[(i(Mi  +  g))  +  (i(Mi  +  g))*'^^! 


where  T2{M,  q)  is  defined  by  (2.5). 

The  following  example  shows  that  the  residual  term  (i(Mi  +  g))*^^  in  (2.8)  is  essential 
and  cannot  be  dispensed  with. 


2.9  Example 


M  = 


-ll 

[0] 

f 

t _ 

’  ll] 

5  =  {0} 


Let  i(e:) 


5  =  {i  €  R^\X2  >0  I2  <  ii). 


e  5 


for  0  <  e  <  1.  Then 


However 


|jx(e)  -  0||oo  _  g 

i(g)(Mi(g)  +  g)  2g2  +  g^ 


oo  as  £■  — >  0. 


k(e)  -  0!;c 


V2 


i(g)(Mi(e)  +  g)  +  (i(£:)(Mi(g)  ^  g)) 


1/2  252  +  +  (2£r2  +  £4)1/2 


as  g 


0. 


In  8.  Lemma  2,  Pang  uses  the  natural  residual  (1.3)  as  an  error  measure  for  the 
positive  definite  linear  complementarity  problem.  It  is  easy  to  show,  by  considering  for 
each  component  i  the  two  cases  of  i,  >  M,i  g,  and  i,  <  M,i  +  g,,  that  the  residual  (1.3) 
is  equivalent  to  i}i  -  (i  -  (Mi  -t-  g))^i;2-  The  following  example  shows  that  (1.3)  cannot 


be  used  as  a  measure  of  error  for  the  positive  semidefinite  case  under  consideration  in  this 
work. 


2.10  Example 


-(?  v)- 


The  unique  solution  of  this  problem  is  x  =  Letting  x(t) 

t  >  2 

x(l)  -  (x(l)  -  (Mx(()  +  ,))  ^  =  (|  _  ^  J  = 

■  *  =  C  0  ') 

W)  - 


we  get  that  for 


Hence 


=  <  —  1— ♦oo  as  t— >  oo. 


lix(t)  -  (x(<)  -  (Mx(t)  +9))^!|2 

Consequently  the  residual  (1.3)  cannot  be  used  as  an  error  bound  for  the  positive  semidef¬ 
inite  case. 

By  noting  that  for  x(x)  €  S 


(-<?)+  <  (Mx(x))_^  <  |Mx(x)| 
l|(-<7)+l|oo  <  |lA/x(x)||oo  <  l|M||ool!i(x)iloo, 

the  following  theorem  and  corollary  follow  directly  from  Theorem  2.7  and  Corollary  2.8 
respectively  thus  giving  rise  to  a  bound  on  the  relative  error  in  i  in  terms 

l|x(l)l|oo 

of  the  condition  number  T2(M,  9)1|M||oo  and  the  corresponding  relative  residual. 

2.11  Theorem  (Relative  error  bound  for  approximate  solutions  of  monotone  linear 
complementarity  problems)  Let  M  be  positive  semidefinite,  let  g  ^  0  and  let  S  ^  <f>.  For 
each  X  in  /?”  there  exists  an  x(x)  in  S  such  that 

-  r2(M,  <7)i|M|ioc[i|(x(Mx  +  (7),  Mx~q,  -x) 

(2.9)  ll^(^)llcx>  '  + 

+  (x(Mx  ^  q)-f  OffWi-Mx  -  q,  -x)+ ||/?)  *^^] /l|(-<7)+ Hoc 

where  T2{M,  q)  is  defined  by  (2.5)  and  by  (2.7). 
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2.12  Corollary  (Relative  error  bound  for  approximate  feasible  solutions  of  monotone 
linear  complementarity  problems)  Let  M  be  positive  semidefinite,  let  ^  ^  0,  and  let  S  ^  0. 
For  each  i  in  S  there  exists  an  x(x)  in  S  such  that 


(2.10) 


||X  -  x(x)||oo 

lil{x)lloo 


<  r2{M,  g)!|Af||ooHA/x  +  ?)  +  (x(Mx  +  9))*^^]/ij(-?)+||oo 


2.13  Remark  When  the  solution  set  S  of  (1.1)  is  bounded,  a^o  of  Theorems  2.7  and 
2.11  can  be  bounded  above  by  a  single  linear  program  as  follows.  5  is  bounded  if  and 
only  if  there  exists  an  x  >  0  such  that  w  :=  Mi  -i-  9  >  0  [5].  Hence  [5]  for  any  x  6  S  and 
XV  :=  Mx  -1-  q  it  follows  that 

xw  -  xib  -  xtv  =  (x  —  x)(tij  —  w)  =  {x  -  x)M[x  —  x)  >  0 


Consequently 


l|x,  tDlli  •  min  {ti,,  X,} 

1  ^  ^  fl 

and  from  the  definition  (2.7)  of  we  have  that 


<  xw  -t-  xw  <  xw 


(2.11)  (Too  =  minljx,  ti>l|i  <  xw !  min  x,} 

2es 

Hence  given  a  monotone  linear  complementarity  problem  (1.1),  one  can  first  solve  the 
linear  program 


(2.12) 


max  {e\Mx  +  q  >  ee,  x  >  ee,  1  >  e  >  0} 


The  maximum  f,  achieved  at  (i,  f),  is  positive  if  and  only  if  5  is  nonempty  and 
bounded,  in  which  case  0^0  is  bounded  above  by  xw/i  where  w  ~  Mx  +  q. 

We  conclude  by  giving  an  interesting  application  of  Corollary  2.8  to  the  dual  quadratic 
programs 


(2.13) 


min  -  zQz  +  cz 

Z  2 


subject  to 


Az  >  b,  z  >  0 


max  -  -  zQz  +  bu  subject  to  -  Qz  +  A^u  <  c,  u  >  0 

z,u  2 


(2.14) 


where  Q  €  is  positive  semidefinite,  A  £  c  E  and  6  G  /?"*.  If  the 

point  (2,  u)  e  is  feasible  for  both  (2.13)  and  (2.14)  then  there  exists  a  solution 

(2(2,  u),  u(2,  u))  to  the  dual  pair  (2.13)-(2.14)  such  that 

(2.15)  11(2,  u)  -  (2(2,  u),  u(2,  u))||oo  <  r2iM,  q)[izQz  +  cz  -  bu)  +  (zQz  +  C2  -  bu)''^j 


where  T2{M,  q)  is  defined  by  (2.5)  and 


M  := 


Q 

A 


e  R 


n  +  m 


Note  that  the  linear  programming  case  is  included  as  the  special  case  of  Q  =  0.  Again  here 
the  square  root  term  in  the  error  bound  (2.15)  is  essential  for  its  validity. 
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